Advances and challenges in automated malaria diagnosis using digital microscopy imaging with artificial intelligence tools: A review

Malaria is an infectious disease caused by parasites of the genus Plasmodium spp. It is transmitted to humans by the bite of an infected female Anopheles mosquito. It is the most common disease in resource-poor settings, with 241 illion malaria cases reported in 2020 according to the World Health Organization. Optical microscopy examination of blood smears is the gold standard technique for malaria diagnosis; however, it is a time-consuming method and a well-trained microscopist is needed to perform the microbiological diagnosis. New techniques based on digital imaging analysis by deep learning and artificial intelligence methods are a challenging alternative tool for the diagnosis of infectious diseases. In particular, systems based on Convolutional Neural Networks for image detection of the malaria parasites emulate the microscopy visualization of an expert. Microscope automation provides a fast and low-cost diagnosis, requiring less supervision. Smartphones are a suitable option for microscopic diagnosis, allowing image capture and software identification of parasites. In addition, image analysis techniques could be a fast and optimal solution for the diagnosis of malaria, tuberculosis, or Neglected Tropical Diseases in endemic areas with low resources. The implementation of automated diagnosis by using smartphone applications and new digital imaging technologies in low-income areas is a challenge to achieve. Moreover, automating the movement of the microscope slide and image autofocusing of the samples by hardware implementation would systemize the procedure. These new diagnostic tools would join the global effort to fight against pandemic malaria and other infectious and poverty-related diseases.The project is funded by the Microbiology Department of Vall d’Hebron Universitary Hospital, the Cooperation Centre of the Universitat Politècnica de Catalunya (CCD-UPC) and the Probitas FoundationPostprint (published version

iMAGING: a novel automated system for malaria diagnosis by using artificial intelligence tools and a universal low-cost robotized microscope

Artificial intelligence; Malaria diagnosis; Robotized microscopeInteligencia artificial; Diagnóstico de malaria; Microscopio robotizadoIntel·ligència artificial; Diagnòstic de malària; Microscopi robotitzatIntroduction: Malaria is one of the most prevalent infectious diseases in sub-Saharan Africa, with 247 million cases reported worldwide in 2021 according to the World Health Organization. Optical microscopy remains the gold standard technique for malaria diagnosis, however, it requires expertise, is time-consuming and difficult to reproduce. Therefore, new diagnostic techniques based on digital image analysis using artificial intelligence tools can improve diagnosis and help automate it. Methods: In this study, a dataset of 2571 labeled thick blood smear images were created. YOLOv5x, Faster R-CNN, SSD, and RetinaNet object detection neural networks were trained on the same dataset to evaluate their performance in Plasmodium parasite detection. Attention modules were applied and compared with YOLOv5x results. To automate the entire diagnostic process, a prototype of 3D-printed pieces was designed for the robotization of conventional optical microscopy, capable of auto-focusing the sample and tracking the entire slide. Results: Comparative analysis yielded a performance for YOLOv5x on a test set of 92.10% precision, 93.50% recall, 92.79% F-score, and 94.40% mAP0.5 for leukocyte, early and mature Plasmodium trophozoites overall detection. F-score values of each category were 99.0% for leukocytes, 88.6% for early trophozoites and 87.3% for mature trophozoites detection. Attention modules performance show non-significant statistical differences when compared to YOLOv5x original trained model. The predictive models were integrated into a smartphone-computer application for the purpose of image-based diagnostics in the laboratory. The system can perform a fully automated diagnosis by the auto-focus and X-Y movements of the robotized microscope, the CNN models trained for digital image analysis, and the smartphone device. The new prototype would determine whether a Giemsa-stained thick blood smear sample is positive/negative for Plasmodium infection and its parasite levels. The whole system was integrated into the iMAGING smartphone application. Conclusion: The coalescence of the fully-automated system via auto-focus and slide movements and the autonomous detection of Plasmodium parasites in digital images with a smartphone software and AI algorithms confers the prototype the optimal features to join the global effort against malaria, neglected tropical diseases and other infectious diseases.The project is funded by the Microbiology Department of Vall d’Hebron University Hospital, the Cooperation Centre of the Universitat Politècnica de Catalunya (CCD-UPC), and the Probitas Foundation

Advances and challenges in automated malaria diagnosis using digital microscopy imaging with artificial intelligence tools: A review

Deep learning; Malaria diagnosis; Microscopic examinationAprenentatge profund; Diagnòstic de malària; Examen microscòpicAprendizaje profundo; Diagnóstico de malaria; Examen microscópicoMalaria is an infectious disease caused by parasites of the genus Plasmodium spp. It is transmitted to humans by the bite of an infected female Anopheles mosquito. It is the most common disease in resource-poor settings, with 241 million malaria cases reported in 2020 according to the World Health Organization. Optical microscopy examination of blood smears is the gold standard technique for malaria diagnosis; however, it is a time-consuming method and a well-trained microscopist is needed to perform the microbiological diagnosis. New techniques based on digital imaging analysis by deep learning and artificial intelligence methods are a challenging alternative tool for the diagnosis of infectious diseases. In particular, systems based on Convolutional Neural Networks for image detection of the malaria parasites emulate the microscopy visualization of an expert. Microscope automation provides a fast and low-cost diagnosis, requiring less supervision. Smartphones are a suitable option for microscopic diagnosis, allowing image capture and software identification of parasites. In addition, image analysis techniques could be a fast and optimal solution for the diagnosis of malaria, tuberculosis, or Neglected Tropical Diseases in endemic areas with low resources. The implementation of automated diagnosis by using smartphone applications and new digital imaging technologies in low-income areas is a challenge to achieve. Moreover, automating the movement of the microscope slide and image autofocusing of the samples by hardware implementation would systemize the procedure. These new diagnostic tools would join the global effort to fight against pandemic malaria and other infectious and poverty-related diseases.The project is funded by the Microbiology Department of Vall d’Hebron Universitary Hospital, the Cooperation Centre of the Universitat Politècnica de Catalunya (CCD-UPC) and the Probitas Foundation

Advances and challenges in automated malaria diagnosis using digital microscopy imaging with artificial intelligence tools : A review

Malaria is an infectious disease caused by parasites of the genus Plasmodium spp. It is transmitted to humans by the bite of an infected female Anopheles mosquito. It is the most common disease in resource-poor settings, with 241 million malaria cases reported in 2020 according to the World Health Organization. Optical microscopy examination of blood smears is the gold standard technique for malaria diagnosis; however, it is a time-consuming method and a well-trained microscopist is needed to perform the microbiological diagnosis. New techniques based on digital imaging analysis by deep learning and artificial intelligence methods are a challenging alternative tool for the diagnosis of infectious diseases. In particular, systems based on Convolutional Neural Networks for image detection of the malaria parasites emulate the microscopy visualization of an expert. Microscope automation provides a fast and low-cost diagnosis, requiring less supervision. Smartphones are a suitable option for microscopic diagnosis, allowing image capture and software identification of parasites. In addition, image analysis techniques could be a fast and optimal solution for the diagnosis of malaria, tuberculosis, or Neglected Tropical Diseases in endemic areas with low resources. The implementation of automated diagnosis by using smartphone applications and new digital imaging technologies in low-income areas is a challenge to achieve. Moreover, automating the movement of the microscope slide and image autofocusing of the samples by hardware implementation would systemize the procedure. These new diagnostic tools would join the global effort to fight against pandemic malaria and other infectious and poverty-related diseases

iMAGING: a novel automated system for malaria diagnosis by using artificial intelligence tools and a universal low-cost robotized microscope

IntroductionMalaria is one of the most prevalent infectious diseases in sub-Saharan Africa, with 247 million cases reported worldwide in 2021 according to the World Health Organization. Optical microscopy remains the gold standard technique for malaria diagnosis, however, it requires expertise, is time-consuming and difficult to reproduce. Therefore, new diagnostic techniques based on digital image analysis using artificial intelligence tools can improve diagnosis and help automate it.MethodsIn this study, a dataset of 2571 labeled thick blood smear images were created. YOLOv5x, Faster R-CNN, SSD, and RetinaNet object detection neural networks were trained on the same dataset to evaluate their performance in Plasmodium parasite detection. Attention modules were applied and compared with YOLOv5x results. To automate the entire diagnostic process, a prototype of 3D-printed pieces was designed for the robotization of conventional optical microscopy, capable of auto-focusing the sample and tracking the entire slide.ResultsComparative analysis yielded a performance for YOLOv5x on a test set of 92.10% precision, 93.50% recall, 92.79% F-score, and 94.40% mAP0.5 for leukocyte, early and mature Plasmodium trophozoites overall detection. F-score values of each category were 99.0% for leukocytes, 88.6% for early trophozoites and 87.3% for mature trophozoites detection. Attention modules performance show non-significant statistical differences when compared to YOLOv5x original trained model. The predictive models were integrated into a smartphone-computer application for the purpose of image-based diagnostics in the laboratory. The system can perform a fully automated diagnosis by the auto-focus and X-Y movements of the robotized microscope, the CNN models trained for digital image analysis, and the smartphone device. The new prototype would determine whether a Giemsa-stained thick blood smear sample is positive/negative for Plasmodium infection and its parasite levels. The whole system was integrated into the iMAGING smartphone application.ConclusionThe coalescence of the fully-automated system via auto-focus and slide movements and the autonomous detection of Plasmodium parasites in digital images with a smartphone software and AI algorithms confers the prototype the optimal features to join the global effort against malaria, neglected tropical diseases and other infectious diseases

Malaria System : uma ferramenta para diagnóstico automático de malária em dispositivos móveis

A malária é um problema de saúde pública mundial e está relacionada principalmente a áreas remotas. Deste modo, os sistemas de baixo custo para o diagnóstico automático tornam-se uma investigação prioritária em vários grupos de pesquisa. Por outro lado, há novos casos, devido a mudanças climáticas que permitem a sobrevivência do Anopheles em áreas antes não habitadas. Os dispositivos móveis têm sido alternativas viáveis em diversos sistemas de saúde e de controle epidemiológico. Os grupos de pesquisa EpiSchisto Risk Modeling e Discrete Modelling and Simulation of Biological Systems desenvolveram ferramentas de diagnóstico automático para doenças, incluindo a esquistossomose e malária. Neste trabalho, é apresentado um sistema de detecção de parasitos de malária a baixo custo com dispositivos móveis, onde o estado da arte envolve duas grandes áreas do conhecimento: na área de computação e uma relacionada a saúde pública. O uso de técnicas de visão computacional e inteligência artificial neste projeto são os fundamentos teóricos do sistema de detecção de malária de baixo custo aqui apresentado. As fases de desenvolvimento do sistema sâo: captura de imagem - a imagem é capturada usando um sistema de dispositivo móvel experimental acoplado e um microscópio; segmentação - esta etapa consiste em remover a base em torno células do sangue, reduzindo assim o escopo da pesquisa do algoritmo de reconhecimento; treinamento e classificação - utilização de técnicas de inteligência artificial para treinar imagens como: positivos e falsos positivos (com e sem parasitos da malária). Um sistema baseado em Android foi desenvolvido, ele e capaz de detectar células infectadas com Plasmodium spp em uma imagem. Este e limitado na identificação do parasito em espécie P. falciparum (estágio trofozo to). A taxa de acerto do sistema em seu melhor desempenho está atualmente em 93%. A principal contribuição do Malariasystem e o baixo custo e a possibilidade de ser utilizado por agentes de saúde pública em regiões endêmicas remotas, onde os recursos são escassos. Além disso, os resultados podem ser avaliados in loco, facilitando o tratamento imediato.Malaria is a worldwide public health problem and it is mainly related to remote areas. In this way, low cost systems for automatic diagnosis has becomed a priority investigation in several research groups. On the other hand, there are new cases due to climate changes which allow the survival of Anopheles in areas previously not inhabited.Mobile devices have been viable alternatives in several health systems and epidemiological control. The research groups EpiSchisto Risk Modeling and Discrete Modelling and Simulation of Biological Systems have developed automatic diagnostic tools for diseases including schistosomiasis and malaria. In this work, a detection system for Plasmodium parasites (malaria) at low cost with mobile devices is presented, where the state of the art involves two broad areas of knowledge in computing and related to public health. The use of techniques of computer vision and arti cial intelligence in this project is the theoretical foundations of the detection system for low-cost malaria presented here. The development phases of the system are: capture image - the image is captured using a coupled experimental mobile device system and a microscope; segmentation - This step consists in removing the background around blood cells, thereby reducing the search scope of the recognition algorithm; training and classi cation - sorting through arti cial intelligence techniques for training with positive and false positive images (with and without malaria parasites).An Android based system was developed, it nds the Plasmodium infected parasites in the image. This is limited on the identi cation of the parasite into P.falciparum specie (step trophozoite).The hit rate of the system at its best performance is currently in 93%. The main contribution of Malariasystem is the low cost and the ability to be used by public health o cials in remote endemic regions , where resources are scarce. Furthermore the results can be evaluated in loco, facilitating immediate treatment

Table_1_iMAGING: a novel automated system for malaria diagnosis by using artificial intelligence tools and a universal low-cost robotized microscope.DOCX

IntroductionMalaria is one of the most prevalent infectious diseases in sub-Saharan Africa, with 247 million cases reported worldwide in 2021 according to the World Health Organization. Optical microscopy remains the gold standard technique for malaria diagnosis, however, it requires expertise, is time-consuming and difficult to reproduce. Therefore, new diagnostic techniques based on digital image analysis using artificial intelligence tools can improve diagnosis and help automate it.MethodsIn this study, a dataset of 2571 labeled thick blood smear images were created. YOLOv5x, Faster R-CNN, SSD, and RetinaNet object detection neural networks were trained on the same dataset to evaluate their performance in Plasmodium parasite detection. Attention modules were applied and compared with YOLOv5x results. To automate the entire diagnostic process, a prototype of 3D-printed pieces was designed for the robotization of conventional optical microscopy, capable of auto-focusing the sample and tracking the entire slide.ResultsComparative analysis yielded a performance for YOLOv5x on a test set of 92.10% precision, 93.50% recall, 92.79% F-score, and 94.40% mAP0.5 for leukocyte, early and mature Plasmodium trophozoites overall detection. F-score values of each category were 99.0% for leukocytes, 88.6% for early trophozoites and 87.3% for mature trophozoites detection. Attention modules performance show non-significant statistical differences when compared to YOLOv5x original trained model. The predictive models were integrated into a smartphone-computer application for the purpose of image-based diagnostics in the laboratory. The system can perform a fully automated diagnosis by the auto-focus and X-Y movements of the robotized microscope, the CNN models trained for digital image analysis, and the smartphone device. The new prototype would determine whether a Giemsa-stained thick blood smear sample is positive/negative for Plasmodium infection and its parasite levels. The whole system was integrated into the iMAGING smartphone application.ConclusionThe coalescence of the fully-automated system via auto-focus and slide movements and the autonomous detection of Plasmodium parasites in digital images with a smartphone software and AI algorithms confers the prototype the optimal features to join the global effort against malaria, neglected tropical diseases and other infectious diseases.</p

Image_1_iMAGING: a novel automated system for malaria diagnosis by using artificial intelligence tools and a universal low-cost robotized microscope.TIFF

IntroductionMalaria is one of the most prevalent infectious diseases in sub-Saharan Africa, with 247 million cases reported worldwide in 2021 according to the World Health Organization. Optical microscopy remains the gold standard technique for malaria diagnosis, however, it requires expertise, is time-consuming and difficult to reproduce. Therefore, new diagnostic techniques based on digital image analysis using artificial intelligence tools can improve diagnosis and help automate it.MethodsIn this study, a dataset of 2571 labeled thick blood smear images were created. YOLOv5x, Faster R-CNN, SSD, and RetinaNet object detection neural networks were trained on the same dataset to evaluate their performance in Plasmodium parasite detection. Attention modules were applied and compared with YOLOv5x results. To automate the entire diagnostic process, a prototype of 3D-printed pieces was designed for the robotization of conventional optical microscopy, capable of auto-focusing the sample and tracking the entire slide.ResultsComparative analysis yielded a performance for YOLOv5x on a test set of 92.10% precision, 93.50% recall, 92.79% F-score, and 94.40% mAP0.5 for leukocyte, early and mature Plasmodium trophozoites overall detection. F-score values of each category were 99.0% for leukocytes, 88.6% for early trophozoites and 87.3% for mature trophozoites detection. Attention modules performance show non-significant statistical differences when compared to YOLOv5x original trained model. The predictive models were integrated into a smartphone-computer application for the purpose of image-based diagnostics in the laboratory. The system can perform a fully automated diagnosis by the auto-focus and X-Y movements of the robotized microscope, the CNN models trained for digital image analysis, and the smartphone device. The new prototype would determine whether a Giemsa-stained thick blood smear sample is positive/negative for Plasmodium infection and its parasite levels. The whole system was integrated into the iMAGING smartphone application.ConclusionThe coalescence of the fully-automated system via auto-focus and slide movements and the autonomous detection of Plasmodium parasites in digital images with a smartphone software and AI algorithms confers the prototype the optimal features to join the global effort against malaria, neglected tropical diseases and other infectious diseases.</p

Image_2_iMAGING: a novel automated system for malaria diagnosis by using artificial intelligence tools and a universal low-cost robotized microscope.TIFF

IntroductionMalaria is one of the most prevalent infectious diseases in sub-Saharan Africa, with 247 million cases reported worldwide in 2021 according to the World Health Organization. Optical microscopy remains the gold standard technique for malaria diagnosis, however, it requires expertise, is time-consuming and difficult to reproduce. Therefore, new diagnostic techniques based on digital image analysis using artificial intelligence tools can improve diagnosis and help automate it.MethodsIn this study, a dataset of 2571 labeled thick blood smear images were created. YOLOv5x, Faster R-CNN, SSD, and RetinaNet object detection neural networks were trained on the same dataset to evaluate their performance in Plasmodium parasite detection. Attention modules were applied and compared with YOLOv5x results. To automate the entire diagnostic process, a prototype of 3D-printed pieces was designed for the robotization of conventional optical microscopy, capable of auto-focusing the sample and tracking the entire slide.ResultsComparative analysis yielded a performance for YOLOv5x on a test set of 92.10% precision, 93.50% recall, 92.79% F-score, and 94.40% mAP0.5 for leukocyte, early and mature Plasmodium trophozoites overall detection. F-score values of each category were 99.0% for leukocytes, 88.6% for early trophozoites and 87.3% for mature trophozoites detection. Attention modules performance show non-significant statistical differences when compared to YOLOv5x original trained model. The predictive models were integrated into a smartphone-computer application for the purpose of image-based diagnostics in the laboratory. The system can perform a fully automated diagnosis by the auto-focus and X-Y movements of the robotized microscope, the CNN models trained for digital image analysis, and the smartphone device. The new prototype would determine whether a Giemsa-stained thick blood smear sample is positive/negative for Plasmodium infection and its parasite levels. The whole system was integrated into the iMAGING smartphone application.ConclusionThe coalescence of the fully-automated system via auto-focus and slide movements and the autonomous detection of Plasmodium parasites in digital images with a smartphone software and AI algorithms confers the prototype the optimal features to join the global effort against malaria, neglected tropical diseases and other infectious diseases.</p